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ABNORMAL SHADOW DETECTING METHOD, ABNORAMAL SHADOW DETECTING 
SYSTEM AND ABNORMAL SHADOW DETCTING PROGRAM 

BACKGROUND OF THE INVENTION 
5 Field of the Invention 

This invention relates to a method of and a system and 
a program for detecting an abnormal shadow in a radiation image, 
and more particularly to an improvement in detecting a 
prospective abnormal shadow. 
10 Description of the Related Art 

In the medical field, to find a diseased part of a patient 
or to observe a diseased part of a patient and diagnose progress 
of disease by reading a radiation image of the object (patient) 
has been a common operation. However, radiation image reading 
15 often depends upon experience and abilities of the reader and 
is not necessarily objective. 

For example, it is necessary to find an abnormal shadow 
representing a growth and/or a micro calcification 
representative of a cancerous part in a mammogram (a radiation 
20 image of a breast) taken for the purpose of a breast cancer 
examination. However, depending on the reader, the abnormal 
shadow range cannot be properly detected. Accordingly, there 
has been a demand to properly detect an abnormal shadow 
including shadows of a growth and a micro calcification 
25 irrespective of the abilities of the reader. 

In order to meet this demand, there have been proposed 
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abnormal shadow detecting systems/ for instance, in U.S. 
Patent No. 5,761,334 in which a prospective abnormal shadow 
region in an image of an object is automatically detected by 
the use of a computer on the basis of image data representing 
5 the image . 

In the abnormal shadow detecting system, a prospective 
abnormal shadow region is automatically detected by the use 
of an iris filter processing which is mainly suitable for 
detecting a growth shadow and/or a morphology filter which is 

10 mainly suitable for detecting a micro calcification shadow. 

In order to improve prospective region detecting 
accuracy, there has been proposed, for instance, in Japanese 
Unexamined Patent Publication No. 2002-109510, a method of 
detecting a prospective abnormal shadow region in two stages 

15 where a characteristic value on the image is calculated for 
the prospective abnormal shadow regions detected by the 
technology described above and whether or not the prospective 
abnormal shadow region is of a malignant one is determined on 
the basis of the calculated characteristic value. 

20 Recently, there have been proposed various methocis of 

detecting a prospective abnormal shadow region in addition to 
the methods using the iris filter and a morphology filter. 
However, whether or not the prospective abnormal shadow region 
is of a malignant one is determined by the same method 

25 irrespective of the method of detecting a prospective abnormal 
shadow region. 
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<. Since the prospective abnormal shadow region has a 
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characteristic which differs by the kind of detection used for 
detecting the prospective abnormal shadow region, the method 
where whether or not the prospective abnormal shadow region 
5 is of a malignant one is determined by the same method 
irrespective of the method of detecting a prospective abnormal 
shadow region cannot fully utilize the characteristic of the 
prospective abnormal shadow region, which can result in 
deterioration in abnormal shadow detecting performance. 

10 SUMMARY OF THE INVENTION 

In view of the foregoing observations and description, 
the primary object of the present invention is to provide a 
method of and a system and a program for detecting an abnormal 
shadow in a radiation image in which the performance of 

15 detecting a prospective abnormal shadow can be improved. 

In accordance with a first aspect of the present 
invention, there is provided an abnormal shadow detecting 
method comprising the steps of detecting primary prospective 
abnormal shadow regions in images of objects by different kinds 

20 of detecting processes, determining whether or not the 
respective primary prospective abnormal shadow regions are of 
a desired abnormal shadow by methods different from each other 
according to the kinds of processes by which the respective 
primary prospective abnormal shadow regions are detected, and 

25 outputting as final prospective abnormal shadow regions only 
primary prospective abnormal shadow regions which are 



determined to be of a desired abnormal shadow. 

In accordance with a second aspect of the present 
invention, there is provided an abnormal shadow detecting 
system comprising a primary prospective region detecting means 
5 which detects primary prospective abnormal shadow regions in 
images of objects on the basis of image data representing the 
images of the objects by different kinds of detecting processes, 
a determining means which determines whether or not the 

» 

respective primary prospective abnormal shadow regions are of 

10 a desired abnormal shadow by methods different from each other 
according to the kinds of processes by which the respective 
primary prospective abnormal shadow regions are detected, and 
a final prospective abnormal shadow region outputting means 
which outputs as final prospective abnormal shadow regions 

15 only primary prospective abnormal shadow regions which are 
determined to be of a desired abnormal shadow* 

The detecting processes may include, for instance, a 
process mainly for detecting a growth shadow region in which 
convergence of density gradients in the image of the object 

20 is calculated by the use of an iris filter and a prospective 
growth shadow region is detected by extracting a region where 
the convergence of density gradients is high, a process mainly 
for detecting a prospective category 3 growth shadow region 
by extracting a region where the contrast is high and the 

25 boundary is clear, a process mainly for detecting a prospective 
asymmetric shadow region in which left and right mammary gland 
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distributions are compared with each other and a prospective 
asymmetric shadow region is detected by extracting regions 
where left and right mammary gland distributions are not 
symmetric, and a process mainly for detecting a prospective 
5 spicule region in which convergence of lines in the lineation 
is calculated and a prospective spicule region is detected by 
extracting a region where the convergence of lines is high. 
The ^^category 3 growth shadow" is a shadow of an abnormal tissue 
which is generally benignant but possibility of being 

10 malignant of which cannot be denied, and the ^^spicule'' is a 
shadow of a linear abnormal tissue which appears along a mammary 
gland of a breast. 

The ^Mesired abnormal shadow" may be, for instance, ^^a 
malignant abnormal shadow", or ^^a benignant abnormal shadow" 

15 or ^'a malignant abnormal shadow and a benignant abnormal 
shadow". That is, when only a malignant abnormal shadow is 
to be detected, the ^^desired abnormal shadow" is ""^a malignant 
abnormal shadow" and when only a benignant abnormal shadow is 
to be detected, the ^Mesired abnormal shadow" is ^^a benignant 

20 abnormal shadow". Further, when a malignant abnormal shadow 
and a benignant abnormal shadow are to be detected together, 
the ^Mesired abnormal shadow" is ^^a malignant abnormal shadow 
and a benignant abnormal shadow". 

Whether or not the respective primary prospective 

2 5 abnormal shadow regions are of a desired abnormal shadow may 
be determined on the basis of a combination of a plurality of 
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characteristic values for the respective primary prospective 
abnormal shadow regions predetermined by the kinds of 
processes by which the respective primary prospective abnormal 
shadow regions are detected. In this case, whether or not the 
5 respective primary prospective abnormal shadow regions are of 
a desired abnormal shadow may be determined on the basis of 
Mahalanobis distances in the plurality of characteristic 
values . 

The ^^characteristic values for the prospective abnormal 
10 shadow region" are those representing features of the 
prospective abnormal shadow region and at the same time 
representing malignancy or benignancy of the prospective 
abnormal shadow region and include, for instance, dispersion,, 
contrast, and an angular moment representing features of a 
15 density histogram for the prospective abnormal shadow region, 
dispersion, deviation, correlation, moment and entropy 
representing features of surrounding parts of the prospective 
abnormal shadow region, and circularity representing features 
in shape of the prospective abnormal shadow region. 
20 The ^^Mahalanobis distance'' is an index of distance used 

for recognition of an image pattern and the value of the 
Mahalanobis distance represents similarity in image pattern 
of one image to another image. A plurality of characteristic 
values representing features of an image pattern are expressed 

25 in vectors^ and the ^^Mahalanobis distance'' is defined to reflect 
difference in vector between a reference image and an image 
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to be^ recQgnized. 

Further it is possible to determine whether or not the 
respective primary prospective abnormal shadow regions are of 
a desired abnormal shadow by the likelihood ratio based on a 
5 Mahalanobis distance. The likelihood ratio based on a 
Mahalanobis distance is defined by a ratio Dml/Dm2 of a 
Mahalanobis distance Dml from a pattern class representing a 
non-malignant shadow which has been empirically obtained to 
a Mahalanobis distance Dm2 from a pattern class representing 

10 a malignant shadow which has been empirically obtained. It 
may be judged that the larger the likelihood ratio is, the 
possibility that the region is of a malignant shadow is stronger, 
and the smaller the likelihood ratio is, the possibility that 
the region is of a non-malignant shadow is stronger. 

15 Accordingly, for instance, it maybe determined that the region 
is of a malignant shadow, when the likelihood ratio is not 
smaller than a threshold value and that the region is of a 
non-malignant shadow, when the likelihood ratio is smaller 
than the threshold value. 

20 In accordance with a third aspect of the present 

invention, there is provided a computer program for causing 
a computer to execute an abnormal shadow detecting process 
comprising the steps of detecting primary prospective abnormal 
shadow regions in images of objects by different kinds of 

25 detecting processes, determining whether or not the respective 
primary prospective abnormal shadow regions are of a desired 
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abnormal s,hadow by methods different from each other according 
to the kinds of processes by which the respective primary 
prospective abnormal shadow regions are detected, and 
outputting as final prospective abnormal shadow regions only 
5 primary prospective abnormal shadow regions which are 
determined to be of a desired abnormal shadow. 

In the present invention, a breast is especially suitable 
as the object. 

In accordance with the present invention, since the 

10 determination process (for determining whether or not the 
primary prospective abnormal shadow region is of a desired 
abnormal shadow) is carried out by a method according to the 
kind of the detection process (by which the primary prospective 
abnormal shadow region is detected) , the determination process 

15 can fully utilize the characteristic of the prospective 
abnormal shadow region reflecting the feature of the detection 
process employed, whereby the accuracy in determination can 
be improved and the abnormal shadow detecting performance can 
be improved. 

2 0 When the determination process is carried out on the 

basis of a combination of a plurality of characteristic values 
for the respective primary prospective abnormal shadow regions 
predetermined by the kinds of the detection process, change 
in detection process can be dealt with by simply changing the 

25 combination of the characteristic values, whereby the 
determination process can be relatively easily arranged and 
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iitipr0vemept of the accuracy in determination can be flexibly 
attempted. 

When the determination process is carried out on the 
basis of Mahalanobis distances in the plurality of 
5 characteristic values, the determination process can be 
carried out on the basis of similarity of the prospective 
abnormal shadow region to an empirically obtained malignant 
abnormal shadow or an empirically obtained benignant abnormal 
shadow, surer determination can be performed. 
10 Since the determination process for narrowing down 

prospective abnormal shadow regions detected by the detection 
process has borne fruit especially in detection of breast 
cancer, whether or not the primary prospective abnormal shadow 
region is of a desired abnormal shadow can be more surely 
15 determined when the object is a breast. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 is a view schematically showing an abnormal 
shadow detecting system in accordance with an embodiment of 
the present invention. 
20 DESCRIPTION OF THE PREFERRED EMBODIMENT 

In Figure 1, an abnormal shadow detecting system 1 in 
accordance with an embodiment of the present invention 
comprises a primary prospective region detecting means 10 
which detects primary prospective abnormal shadow regions in 
25 images of objects on the basis of image data P representing 
the images of the objects by different kinds of detecting 
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processes^ a determining means 20 which determines whether or 
not the respective primary prospective abnormal shadow regions 
are of a desired abnormal shadow by methods different from each 
other according to the kinds of processes by which the 
5 respective primary prospective abnormal shadow regions are 
detected, and a final prospective abnormal shadow region 
outputting means 30 which outputs as final prospective 
abnormal shadow regions Qj only primary prospective abnormal 
shadow regions which are determined to be of a desired abnormal 
10 shadow. 

The primary prospective region detecting means 10 
comprises an iris filter detecting means 11 mainly for 
detecting a primary prospective growth shadow region, a 
contrast detecting means 12 mainly for detecting a primary 

15 prospective category 3 growth shadow region, an asymmetry 
detecting means 13 mainly for detecting a primary prospective 
asymmetric shadow region, and a spicule detecting means 14 
mainly for detecting a primary prospective spicule region. 

The determining means 20 comprises an iris filter 

20 determining means 21 which determines whether or not the 
primary prospective abnormal shadow regions Qli detected by 
the iris filter detecting means 11 are of a desired abnormal 
shadow, a contrast determining means 22 which determines 
whether or not the primary prospective abnormal shadow regions 

25 Q2i detected by the contrast detecting means 12 are of a desired 
abnormal shadow, an asymmetry determining means 23 which 
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determine? whether or not the primary prospective abnormal 
shadow regions Q3i detected by the asymmetry detecting means 
13 are of a desired abnormal shadow, and a spicule determining 
means 24 which determines whether or not the primary 
5 prospective abnormal shadow regions Q4i detected by the 
spicule detecting means 14 are of a desired abnormal shadow. 

Operation of the abnormal shadow detecting system of this 
embodiment will be described hereinbelow. In this particular 
embodiment, the object image is a radiation image of a breast, 

10 and the desired abnormal shadow is a malignant abnormal shadow. 

When image data P representing a radiation image of a 
breast is input into the abnormal shadow detecting system 1, 
the iris filter detecting means 11 calculates convergence of 
density gradients in the radiation image P by the use of an 

15 iris filter on the basis of the image data P and detects four 
(at most) regions which are higher than any other regions in 
the convergence of density gradients as the primary 
prospective abnormal shadow regions Qlk. Then the iris filter 
determining means 21 calculates a combination Gl of a plurality 

20 of characteristic values in the respective primary prospective 
abnormal shadow regions Qlk. The combination Gl is of a 
plurality of characteristic values which are suitable for 
determining whether or not the primary prospective abnormal 
shadow region Qlk is of a desired abnormal shadow. Further, 

25 the iris filter determining means 21 determines whether or not 
the primary prospective abnormal shadow region Qlk is of a 
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malignant , abnormal shadow by the use of Mahalanobis distances 
of the characteristic values in the combination Gl calculated. 

First, the Mahalanobis distance Dml of the primary 
prospective region from a pattern class (i=l) representing a 
5 non-malignant shadow which has been empirically determined and 
the Mahalanobis distance Dm2 of the primary prospective region 
from a pattern class (i=2) representing a malignant shadow 
which has been empirically determined are calculated according 
to the following formula (1) . 

10 Dmi = {—^ JiT^y-^-'i—T^ ^) ... (1) 

wherein represents a covariance matrix of a pattern class 
(a non-malignant pattern, when i=l, a malignant pattern when 
i=2) wi, that is, 

wherein t represents a transposed vector (a transverse vector) , 
— represents a characteristic value x in vector (that is, 

— ;^=(xl, x2, , xN) , represents an inverse matrix of 

20 , and — ^r— > represents the average of the pattern class wi 

(that is, — i--^ = (l/A^OZ^^) • 

xewi 

The characteristic values in the combination Gl 
respectively correspond to xl to xN and express an 

N-dimensional space (xl, x2, , xN) . The Mahalanobis 

25 distance between the pattern of the primary prospective region 
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as express.ed on the N-dimensional pattern space and the pattern 
of a non-malignant shadow as expressed on the N-dimensional 
pattern space is Dml, the Mahalanobis distance between the 
pattern of the primary prospective region as expressed on the 
5 N-dimensional pattern space and the pattern of a malignant 
shadow as expressed on the N-dimensional pattern space is Dm2 . 

The non-malignant shadow pattern and the malignant 
shadow pattern are pattern spaces defined by vectors x which 
have been set respectively for non-malignant shadows and 

10 malignant shadows on the basis of the result of investigation 
on a lot of prospective abnormal shadows. For example, the 
pattern class wl of non-malignant shadows is defined by the 
average of the vectors x of non-malignant shadows, and the 
pattern class w2 of malignant shadows is defined by the average 

15 of the vectors x of malignant shadows. 

For example, when the prospective region is of a 
malignant shadow, there is a tendency for the Mahalanobis 
distance from the pattern class of the malignant shadow to be 
short (Dm2 is small) and for the Mahalanobis distance from the 

2 0 pattern class of the non-malignant shadow to fluctuate. To 
the contrast, when the prospective region is of a non- malignant 
shadow, there is a tendency for the Mahalanobis distance from 
the pattern class of the non-malignant shadow to be short (Dml 
is small) and for the Mahalanobis distance from the pattern 

25 class of the malignant shadow to fluctuate . A likelihood ratio 
(Dml/Dm2) for distinguishing the malignant shadow from the 
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non-malignant shadow according to these tendencies is 
calculated for each of the prospective regions. 

The likelihood ratio is defined by Dml/Dm2 and as the 
likelihood ratio is larger, the probability that the 
5 prospective region is of a malignant shadow is stronger and 
as the likelihood ratio is smaller, the probability that the 
prospective region is a non- malignant shadow is stronger. For 
instance, it is determined that the prospective region is of 
a malignant shadow when the likelihood ratio is not smaller 

10 than a predetermined threshold value Th, and that the 
prospective region is of a non-malignant shadow when the 
likelihood ratio is smaller than the threshold value Th. 

Then the contrast detecting means 12 calculates on the 
basis of the image data P an index representing contrast to 

15 the surrounding and clearness of the boundary and detects two 
(at most) regions which are higher than any other regions in 
the index as the primary prospective abnormal shadow regions 
(of a category 3 growth shadow) Q2k. Then the contrast 
determining means 22 calculates a combination G2 of a plurality 

20 of characteristic values in the respective primary prospective 
abnormal shadow regions Q2k. The combination G2 is of a 
plurality of characteristic values which are suitable for 
determining whether or not the primary prospective abnormal 
shadow region Q2k is of a desired abnormal shadow. Further, 

25 the contrast determining means 22 calculates a likelihood 
ratio of Mahalanobis distances from the combination G2 of a 
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plurality, of characteristic values calculated and determines 
that the primary prospective abnormal shadow region Q2k is of 
a malignant abnormal shadow when the likelihood ratio is not 
smaller than a predetermined threshold value. 
5 Similarly, the asymmetry detecting means 13 calculates 

on the basis of the image data P the degree of asymmetry and 
detects one (at most) region which is higher than any other 
regions in the degree of asymmetry as the primary prospective 
abnormal shadow regions (of an asymmetric shadow) Q3k. Then 

10 the asymmetry detearmining means 23 calculates a combination 
G3 of a plurality of characteristic values in the respective 
primary prospective abnormal shadow regions Q3k. Further, the 
asymmetry determining means 23 calculates a likelihood ratio 
of Mahalanobis distances from the combination G3 of a plurality 

15 of characteristic values calculated and determines that the 
primary prospective abnormal shadow region Q3k is of a 
malignant abnormal shadow when the likelihood ratio is not 
smaller than a predetermined threshold value. 

Similarly, the spicule detecting means 14 calculates the 

20 convergence of lines in the lineation and detects two (at most) 
region which is higher than any other regions in the convergence 
of lines in the lineation as the primary prospective abnormal 
shadow regions (mainly of a spicule shadow) Q4k. Then the 
spicule determining means 24 calculates a combination G4 of 

25 a plurality of characteristic values in the respective primary 
prospective abnormal shadow regions Q4k. Further, the spicule 



15 



deterTtiinincf means 24 calculates a likelihood ratio of 
Mahalanobis distances from the combination G4 of a plurality 
of characteristic values calculated and determines that the 
primary prospective abnormal shadow region Q4k is of a 
5 malignant abnormal shadow when the likelihood ratio is not 
smaller than a predetermined threshold value. 

The combinations Gl to G4 may be, for instance, as shown 
in the following table 1. That is, the combination Gl to be 
calculated for the primary prospective abnormal shadow regions 

10 Qlk detected by the iris filter detecting means 11 may include 
a quadric statistic ^'Correlation'', a quadric statistic 
""^Dif f erence Entropy'', skewness in the circle, entropy in the 
circle, kurtosis in the ring and the like, the combination G2 
to be calculated for the primary prospective abnormal shadow 

15 regions Q2k detected by the contrast detecting means 12 may 
include a quadric statistic ^^Correlation", a quadric statistic 
^'Inverse Difference Moment", a quadric statistic ^'Difference 
Entropy", a quadric statistic ''Sum Entropy", secondary moment 
in the circle and the like, the combination G3 to be calculated 

20 for the primary prospective abnormal shadow regions Q3k 
detected by the asymmetry detecting means 13 may include a 
quadric statistic ^'Inverse Difference Moment", skewness in the 
circle, entropy in the circle, kurtosis in the ring, entropy 
in the ring and the like, and the combination G4 to be calculated 

25 for the primary prospective abnormal shadow regions Q4k 
detected by the spicule detecting means 14 may include 
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secondary .moment in the circle^ secondary moment in the ring^ 
entropy in the ring, a quadric statistic ^^Dif ference Variance", 
a quadric statistic ^'Information Measure of Correlation 1'' and 
the like. 



Characteristic value 


Combination of characteristic values 


Gl 


G2 


G3 


G4 


Quadric statistic : Correlation 


o 


o 






Quadric statistic:Sura of Squares : Variance 










Quadric statistic: Inverse Difference Moment 




o 


o 




Quadric statistic : Difference Entropy 


o 


o 






Quadric s tat is tic : Sum Entropy 




o 






Spreadness 










Variance in the Circle 










Secondary Moment in the Circle 




o 




o 


Energy in the Circle 










area 










Variance in the Ring 










Energy in the Ring 










Secondary Moment in the Ring 




o 




o 


Skewness in the Circle 




o 


o 




Kurtosis in the Circle 


o 








Average in the Circle 










Entropy in the Circle 


o 


o 


o 




Skewness in the Ring 




o 






Kurtosis in the Ring 


o 




o 





17 



A V e--f ag, e in the Ring 










Entropy in the Ring 


O 


o 


o 


o 


Quadric Statistic: Angular Second moment 


O 








Quadric 5 t a t i s t i c : C o n t r a s t 










Quadric Statistic : Sum Average 


o 








Quadric Statistic : Sum Variance 


o 








Quadric S t a t i s t i c : E n t r o p y 




o 






Quadric Statistic : Difference Variance 






o 


o 


Quadric Statistic :Infoiiation measure of Correlation 1 






o 


o 


Quadric Information measure of Correlation 2 




o 






Quadric Statistic: Maximal Correlation Coefficient 











The final prospective abnormal shadow region outputting 
means 30 outputs as final prospective abnormal shadow regions 
Qj only primary prospective abnormal shadow regions which are 
5 determined to be of a desired abnormal shadow by the respective 
determining means . A plurality of prospective abnormal shadow 
regions which are close to each other in the center thereof 
or the center of gravity of brightness may be united to one 
prospective region so that one region is not repeatedly 
10 detected as the prospective abnormal shadow region. 

In the abnormal shadow detecting system 1 of this 
embodiment, since the primary prospective region detecting 
means 10 detects primary prospective abnormal shadow regions 
in images of objects in different processes on the basis of 
15 image data P representing the objects, the determining means 



20 determines whether or not the respective primary 
prospective abnormal shadow regions are of a desired abnormal 
shadow by methods different from each other according to the 
kinds of processes by which the respective primary prospective 
5 abnormal shadow regions are detected, and a final prospective 
abnormal shadow region outputting means 30 outputs as final 
prospective abnormal shadow regions only primary prospective 
abnormal shadow regions which are determined to be of a desired 
abnormal shadow, the determination process can fully utilize 

10 the characteristic of the prospective abnormal shadow region 
reflecting the feature of the detection process employed, 
whereby the accuracy in determination can be improved and the 
abnormal shadow detecting performance can be improved. 

Though, in the embodiment described above, the 

15 characteristic values in each prospective abnormal shadow 
region are calculated, each time one detecting means detects 
prospective abnormal shadow regions, the characteristic 
values in each prospective abnormal shadow region may be 
calculated in other procedures without limited to the 

20 procedure described above in conjunction with the above 
embodiment. For example, the characteristic values in each 
prospective abnormal shadow region may be calculated after all 
the detecting means detects the primary prospective abnormal 
shadow regions . 

25 Further, combinations of characteristic values are only 

an example and may be variously arranged. 
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